N90- 20655 


KNOWLEDGE REPRESENTATION 
IN 

SPACE FLIGHT OPERATIONS 

Carl Busse 

Jet Propulsion Laboratory 
California Institute of Technology 


In space flight operations rapid understanding of the state of the space vehicle is essential. Representation 
of knowledge depicting space vehicle status in a dynamic environment presents a difficult challenge. Space 
flight operations personnel must work rapidly integrating personal experience with knowledge representation 
provided by real-time data driven displays. Traditional methods have presented only an incomplete sumnation of 
limited system and subsystem information. 

New avenues of graphics technology have provided a means for rapid display of complex knowledge and detailed 
parametric interrelationships. The use of large high resolution displays coupled with fast display update 
rates, on-screen cormand menu selection, as well as the inclusion of computer graphics and color oriented 
knowledge representation and intelligent screen formatting have allowed a rapid transition from information 
representation to human response. 

The NASA Jet Propulsion Laboratory has pursued areas of technology associated with the advancement of spacecraft 
operations envi r orient. This has led to the development of several advanced mission systems which incorporate 
enhanced graphics capabilities. 

These systems include: 

1) Spacecraft Health Automated Reasoning Prototype (SHARP), 

2) Spacecraft Monitoring Environment (SME), 

3) Electrical Power Data Monitor (EPOM), 

4) Generic Payload Operations Control Center (GPOCC), and 

5) Telemetry System Monitor Prototype (TSM). 

knowledge representation in these systems provides a direct representation of the intrinsic images associated 
with the instrument and satellite telemetry and teLecommjni cat ions systems. The man-machine interface includes 
easily interpreted contextual graphic displays. These interactive video displays contain multiple display 
screens with pop-up windows and intelligent, high resolution graphics linked through context and mouse-sensitive 
icons and text. 


INTRODUCTION 

The Jet Propulsion Laboratory 
is a lead center for NASA’s 
planetary exploration and earth 
science program. In support of 
this role JPL has pursued areas 
of technology associated with 
the advancement of the space- 
craft operations environment. 

The space flight operations 
environment presents large vol- 
umes of rapidly changing and 
complex information to flight 
control personnel. Rapid com- 
prehension of spacecraft and 
ground support systems condi- 
tions are essential in flight 


operations. Representing com- 
plex knowledge is a difficult 
challenge because it requires 
operations personnel to in- 
tegrate on-screen representa- 
tion with past cognitive ex- 
perience to often make demand- 
ing instantaneous decisions. 

The Institutional Computing and 
Mission Operations Division 
(37) of the JPL provides the 
flight control and data manage- 
ment teams, which have sup- 
ported NASA space mission from 
Explorer 1, to the Viking 
spacecraft landing on Mars 
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and the Voyager mission to the 
outer rim of the solar system 
and beyond. 

The Division's concentration of 
on technology in the mission 
operations domain has centered 
on the use of enhanced graphics 
in support of spacecraft and 
related ground system command 
and control functions. En- 
hanced graphics capability in 
the mission environment is sig- 
nificant for three reasons. 
First, carefully presented high 
level knowledge representation 
reduces the workload of opera- 
tions personnel. Second, com- 
puter-based graphics tools 
fSchneiderman 1987] improve ac- 
curacy of data processing and 
assist space flight control 
personnel in monitoring space- 
craft and mission sensors where 
operating data rates may great- 
ly exceed the ability of in- 
dividuals to monitor success- 
fully. And third, as the num- 
ber of missions increases, the 
number of trained and ex- 
perienced flight support per- 
sonnel cannot keep up with the 
extreme demands caused by in- 
formation overload. Graphic 
aids and on-screen operator 
assistance allow for produc- 
tivity enhancement and main- 
taining the required level of 
flight support. fHansen 19881 

KNOWLEDGE REPRESENTATION 

Systems knowledge can be repre- 
sented be via easily visualized 
contextual graphic displays 
f Park 1985 1 . These interactive 
video displays provide a direct 
representation of the intrinsic 
images associated with instru- 
ment and satellite telemetry 
and telecommunications systems. 
Multiple display screens with 
pop-up windows and high resolu- 
tion graphics are linked 


throughgh context and mouse- 
sensitive icons and text. 

In order to optimize JPL's mis- 
sion operations environment, 
the Space Flight Operations 
Section (371) and the Project 
Test and Operations Section 
(374) have developed unique 
methods of knowledge 
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Figure 1 Typical Alphanumeric 
Spacecraft Telecommunications 
Display 
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representation. Mission opera- 
tions needs have included on- 
screen display of data since 
the days of Explorer I. These 
original capabilities have 
slowly evolved as have the 
machines driving them. These 
capabilities, evolved in the 
present realm of graphics capa- 
bility, include primarily al- 
phanumerical paged displays, 
such as seen in Figure 1, which 
have been standardized since 
the Viking Mars landing and the 
launch of the Voyager spacecra- 
ft. Arrows in the display in- 
dicate the latest telemetry 
data channels updated. These 
traditional displays have met 
needs of space flight oper- 
ationss because of relatively 
large mission operations staffs 
and relatively low spacecraft 
data rates. As the number of 
Flight Operations personnel are 
reduced and mission operations 
are streamlined due to budget- 
ary and other considerations, 


existing personnel and support 
systems must function at peak 
capacity. The Institutional 
Computing and Mission Opera- 
tions Division (37) is attempt- 
ing to satisfy mission opera- 
tions requirements of the fu- 
ture by employing the latest 
available graphics technology 
to provide knowledge represen- 
tation as an aid to flight ope- 
rations. A display reflecting 
increased use of visualization 
techniques can be seen in Figu- 
re 2 . A key element in flight 
operations is the need to adeq- 
uately represent knowledge con- 
cerning states and events. The 
graphics requirements needed to 
satisfy these needs consist of 
unique representational goals. 

Specifically included as the 
primary knowledge representa- 
tion goals in the design of 
graphics tools shown in table 
I. 


Table I. 


1. Realtime display of large volumes of diverse information 

2. Rapid presentation of complex interrelated information 

3. Color categorization of interrelated and multiple related 
data fields 

4 . Instantaneous display and detection of changes 

5. Promote visualization by decomposition of data into 
structures and control flows diagrams 

6. Enhanced interpretation of information 

7. Graphical representation of knowledge states 


The Institutional Computing and 
Mission Operations Division has 
attempted to utilize advances 
in display technology to ad- 
vance the spacecraft operations 
environment. This work has led 
to development of innovative 
mission systems which incor- 
porate enhanced graphics capab- 
ilities to assist in flight 
operations visualization. 


This effort has led to develop- 
ment of graphics systems which 
provide improved representation 
of system knowledge which im- 
proves the JPL spacecraft and 
instrument command and control 
process. Because of the large 
screen space graphic represent- 
ations require these systems 
mix graphics with textual rep- 
resentation. The flight 


27 


support system mentioned incor- flight control systems require, 

porate several factors in com- as a minimum, the capabilities 

mon which aid in knowledge rep- shown in table II. 

resentation and effective visu- 
alization of intelligence. 

Knowledge representation in 

Table II. 


1. Large high resolution displays 

2. High level windowing capability 

3. On-screen pull-down command menu selection 

4. Color oriented knowledge representation 

5. Rapid transition from informational representation to 
user response 


Five flight support systems have been developed which provide 
examples of knowledge representation through data visualization 
made possible by graphics technology. These systems are: 

1) Spacecraft Health Automated Reasoning Prototype (SHARP) , 

2) Spacecraft Monitoring Environment (SME) , 

3) Electrical Power Data Monitor (EPDM) , and 

4) Generic Payload Operations Control Center (GPOCC) , and 


5) Telemetry System Monitor (TSM) 

Spacecraft Health Automated 
Reasoning Prototype (SHARP) 

The Spacecraft Health Automated 
Reasoning Prototype incor- 
porates experience of the lead 
Voyager spacecraft telecom- 
munications engineer into a 
usable knowledge base. The 
Space Flight Operations Section 
(371) has provided an indepen- 
dent standalone graphics cap- 
ability for the prototype. 

These representational capa- 
bilities will be used in sup- 
port of the Voyager spacecraft- 
's upcoming Neptune Encounter. 
System know-ledge is represent- 
ed in terms of annotated space 
and ground systems context dia- 
grams. Displayed objects are 
icons and selectable via mouse 
or keyboard. 



Figure 3 GRAPHICS DISPLAY FOR 
SHARP 
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Spacecraft Monitoring Environ- 
ment (SME) 


The Spacecraft Monitoring En- 
vironment has been developed by 
the Project Test and Operations 
Section (374) and Aura Systems 
to aid in the Galileo space- 
craft integration and test pro- 
cess. The SME provides a real 
time autonomous spacecraft test 
sequencing and data monitoring 
of integration and test ac- 
tivity. The SME provides high- 
level contextual graphic dis- 
plays and windowing capability. 
Command success knowledge is 
presented by windowing of com- 
mand issued with telemetry re- 
sponses . 



Figure 4 KNOWLEDGE REPRESEN- 
TATION IN AN SME TEXTUAL DIS- 
PLAY 


Electrical Power Data Monitor 
( EPDM) 

The Electrical Power Data Moni- 
tor is being developed by the 
Electrical Power Systems Sec- 
tion (342) and Aura Systems. 
The EPDM provides power system 
engineers with automated con- 
text diagrams representing 
power system knowledge r Bahrami 
1987 1 . The EPDM will support 
the Voyager spacecraft during 
the up-coming Neptune En- 
counter. EPDM contextual re- 
presentation power system know- 
ledge is should in figure 5. 



Figure 5 EPDM CONTEXTUAL DIS- 
PLAY 
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Generic Payload Operations Con- 
trol Center (GPOCC) 

The Generic Payload Operations 
Control Center is a conceptual 
prototype developed by the Pro- 
ject Test and Operations Sec- 
tion (374) and Aura Systems to 
apply automation and high level 
graphics capability to a mis- 
sion operations environment. 
The GPOCC goal is to couple 
expert systems with high level 
contextual graphics to display 
to increase user comprehension 
f D-54 3 5 1987 ] . A prototype was 
developed on an Apple Macintosh 
II to demonstrate user inter- 
faces and functionality of the 
GPOCC concept. An example of 
GPOCC contextual display repre- 
sentation is shown in figure 6. 



Figure 6 GPOCC CONTEXT DIS- 
PLAY 


Telemetry System Monitor (TSM) 

The Telemetry System Monitor 
(TMS ) expert system, was devel- 
oped by the Divisions In- 
strumentation Section (375) . 
This system, using ART as ex- 
pert system shell was developed 
on a Sun workstation. The TSM 
uses graphics capability to aid 
in rapid visualization of the 
health and display status of 
the Galileo Mission Ground pro- 
cessing system and display sys- 
tem fault cues FMouneimne 1989- 
J.. Knowledge relating the 
well-being of the telemetry 
system is contained in expert 
systems text messages. The 
graphic display pin-points 
faults area. An example of TSM 

Table 


representation is shown in fig- 
-ure 2 . 

Knowledge Representation in 
Future Mission Operations 

As spacecraft data rates in- 
crease (the Earth Observing 
System project 300 Mbps) , and 
are support by extremely large 
and distributed ground data 
system the need to provide in- 
terpretive knowledge of systems 
status and configuration in- 
creases. Graphics visualiza- 
tion will continue to provide 
a significant means to ac- 
complish knowledge represent- 
nation. Future considerations 
in knowledge representation are 
shown in table III. 

III. 


1. Visual man-machine communication to replace 
alphanumeric communication. 

2. Inclusion of hyper-media (including voice 
synthesis in knowledge representation. 

3. Highly interactive display devices 
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SUMMARY 

Knowledge representation in 
these systems provides a direct 
representation of the intrinsic 
images associated with satel- 
lite and ground support tele- 
communications systems. The 
man-machine interface includes 
easily interpreted contextual 
graphic displays. These inter- 
active video displays contain 
multiple display screens with 
pop-up windows and intelligent, 
high resolution graphics linked 
through context and mouse-sen- 
sitive icons and text. 
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